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Abstract 

£^ , In this paper, we first form a method to calculate the probability gen- 

1 erating function of the total progeny of multitype branching process. 

£Nj ■ As examples, we calculate probability generating function of the to- 

tal progeny of the multitype branching processes within random walk 
which could stay at its position and (2-1) random walk. Consequently, 
■ we could give the probability generating functions and the distributions 

^ (-h of the hitting time of corresponding random walks, 

-i— > ■ 
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^ ! 1 Introduction 

ov 

(N- 1.1 Motivation 

Let {A^ n } be a simple random walk, that is, {A^ n } is a Markov chain with initial value and 
transitional probability P(X n+ i = X n + l\X n , ...,X ) = p = 1 - P(X n+ \ = X n + l\X n , ...,X ), 
where < p < 1. Define T = inf [n > : X n = 1] the hitting time of position 1. One follows, for 
7— I ■ example from reflection principle, that 

S : PiT = 2 " + 1] = ^Ti ( » + 1 1 ) - «■>"• " a °- (1) 

Also one has that the probability generating function of T, 



«.) :_ E(s-) = 1 - V1 2q - imS ' , W < 1. (2) 

For the specific calculation of JT]) and ([2]), see for example, Strook [8]. Next, we consider some 
more general random walk. 

I) . Random walk with stay 

Suppose that {X n } is a random walk which could stay at its position with positive probability 
< r < 1, that is, P{X n+1 = X n + l\X n ,...,X ) = p, P{X n+l = X n - 1|X„,...,A ) = q and 
P{X n+ \ = X n \X n , ...,Xq) = r where p, q, r > and p + q + r = 1. We call {^n} a random walk 
with stay. 

II) . (2-1) random walk 
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Suppose q±,q2 > and p > are three numbers such that q\ + q2 + P = 1. Let {X n } be a 
Markov chain, starting from 0, with transition probabilities 

P(X n+ \ = X n — l\X n , ...,Xq) = qi, I = 1, 2; 
P(X n+l =X n + l\X n ,...,X )=p. 

We call such {X n } an (2-1) random walk. 

III). (L-R) random walk 

Let A := {— L, R}/{0} where L and R are two positive integers and let pi, I £ A be 
positive numbers such that YIieaPi = L Suppose {X n } is a Markov Chain with initial value 
and transition probabilities P{X n+ \ = X n + l\X n , ...,Xq) = pi, I £ A. We call such {X n } a 
random walk with bounded jumps or simply an (L-R) random walk. 

For the random walks described above, we also define 

T = m£[n > : X n > 1] and = £(s T ), |s| < 1. 

Stimulated by ([I]) and ([2]), one natural question is, could we give the distribution of T and 
calculate its probability generating function C( s )? Li general, for the random walks described 
above, it is hard to give the distribution and the probability generating function of T. Indeed, 
in the literatures we are aware of, no such result was given. 

We note that in [9j HI [5j [6] , the authors revealed the intrinsic branching structures within 
random walk with stay, (L-l) random walk, (1-R) random walk, and (L-R) random walk. The 
branching structure for simple random walk was given in Kesten Kozlov and Spitzer [7j. In the 
above mentioned literatures, it has been found that the first passage time T could be expressed 
in terms of the total progeny of the branching process. For simple random walk, the branching 
process is of single type, while for the other cases, the corresponding branching process is of 
multitype. 

For general random walk, though it's hard to tell the distribution of T there are good news. 
Since the first passage time could be expressed in terms of the total progeny of branching 
process, once we give the distribution of the total progeny of multitype branching process, the 
distribution of T follows. 

For the single type Galton- Watson process, the probability generating function of the total 
progeny could be found in Dwass [HE] and also in Feller [3]. 

In this paper, we first study the distribution of the total progeny of multitype branching 
process. We give a method to calculate the probability generating function of the total progeny. 
As two examples, we calculate probability generation functions of the total progeny of the multi- 
type branching process within (2-1) random walk and random walk with stay. Consequently, we 
could calculate the probability generating function of T explicitly. Especially, for the multitype 
branching process within the random walk with stay , in critical case, we show that, the tail 
probability of the total progeny decays as ^= for some constant < C\ < oo when n — > oo. 

Thus, we show that the tail probability of the hitting time T decays as for some constant 
< C2 < oo when n — > oo. 

We remark that for general (L-R) random walk, since the branching structure was revealed in 
Hong- Wang [S], the probability generating function of T follows similarly as that of (2-1) random 
walk and random walk with stay. But the branching structure involves a (l + ... + L)(l-|- ... + R)- 
type branching process. We do not contain such tedious calculation in this paper. 
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1.2 The main results 

Let L be a positive integer. Suppose that Pi(-), i = l,...,L are probability measures on Z^, 
with Z + = {0,1,2,...}. Let {Z n }^ =0 be an L-type Galton- Watson process with the offspring 
distributions P(Z n+ \ = (re^, nS L ^\ \Z n = e^) = p, (fi",...,fi") , i = 1,2, where 6 
with the i-th component 1 and all the others 0. For 1 < i < L define 

♦"l,™ st") 

= £ 

n( 1 ),...,n( L )>0 

being the probability generating function of Z\ given Zq = e^. Introduce 




Y n = ^ ^ Z.[ 



i=0 



being the total progeny of the first n generations of {Z n }. Let Y := lim n _ 5 . 00 Y n , the total progeny 
of the branching process, possibly being oo. Define generating function of Y n 
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gV(sM ) ...,sV) = e\(sU) " ■■■(>)) " \Z = ej, |*«|< 1,1 <Z<L. 

Let niij = ^(j) ■ Then it is known that M := (rriij) E M. LxL is the offspring matrix of {Z n }. Let 
7r( 4 ) = P(Z n = for some n\Z$ = e^) being the extinction probabilities. It will be convenient to 
introduce the vector notations 

s = (* (1) ,...,s (L) ), 

0(s) = (^ 1 )(s),...,0( i )(s)), 

G n (s) = (G( 1 )(s),...,G( i )(s)), 

7T = (vr«,...,7r( L )), 

1 = (1,...,1). 

For simplicity, we write Gi(s) as G(s). For two vectors s = (s^\ s") and n = (n^\ n^), 

we define sn = (s^n^ , s^n^), s n = (sW) n • • • (s^)" and the relation s <C n means 
that < n", for i = 1, ...,L. The norm of a vector s is defined by |s| := max[sW : 1 < i < L}. 
Vectors are always in bold and always means the i-th. component of vector v. But as the 
branching process is involved, we do not use bold symbol. For example, Z n means the n-th 
generation and Y is the total progeny of the branching process. They are all vectors. 

Condition 1 Suppose that <j>(s) are not linear functions of and that M n ° 3> (all 

entry of M n ° are positive) for some integer hq > 1. 

Remark 1 Let a be the eigenvalue of M with largest magnitude. Under Condition 1, one follows 
from Frobenius theorem that a is real and positive. Let ir be the smallest solution of u = (f>(u). 
It's known that n is the extinction probability of the multitype branching process {Z n } and tt = 1 
or <C 1 according as a < 1, or a > 1. 
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Theorem 1 Suppose that Condition 1 holds. Then the limit p{s) := lim n _ 5 . 00 G„(s) exists and 
for fixed s, p(s) is the unique solution of equation 

u = s0(u). (3) 

Moreover, if a < 1, t/ien p(s) is on honest probability generating function. 

Remark 2 Suppose a < 1. TYien £/ie process {Z n } is extinct and p(s) is a probability generating 
function. As the limit of {G n }, p(s) is i/ie probability generating function ofY, that is, p( l \s) = 
E(s Y \Z = e t ), |s| < 1. 

As application of Theorem [IJ we study two special 2- type branching process which are connected 
with random walk with stay and (2-1) random walk respectively. 

Theorem 2 Let {Z n } n >Q be a 2-type branching process with offspring distributions 

P (Z n+1 = (a, b)\Z n = e x ) = i^i<V 6 p, a,b > (4) 

a'.bl 

P(Z n+1 = 0\Z n = e 2 ) = l, (5) 

where p,q,r > and p + q + r = 1. Let = Y27=o anc ^ ^ = nm rn>oo^n- 27ien we /iaue 
Suppose that q < p. Then P(Y < oo) = 1 and the probability generating function ofY 

P (s) = (p«(s), P ( 2 )(s)) = ( ^_ — > s my (6) 

Moreover, if p = q = -^p and -P(^o = e i) = 1 then 



lim ^P(|y|>n)= l/i±r ( 7 ) 



/asi, i/ we replace {5]) by 



P(Z n+1 = (a + l,b)\Z n = ei ) = ^-^q a r b p, a,b>0, (8) 

a!o! 



i/ien /^^(u) is i/ie smallest real solution of 



ana'p( 2 ) = (p( 1 )) 2 Hgl. 



Remark 3 T/ie branching process {Z n } determined by and f5|) corresponds to branching 
structure for random walk with stay and the one determined by ^ and (C§J) corresponds to 
branching structure for (2-1) random walk. 

Since the hitting time T of random walk could be expressed in terms of the total progeny Y of 
the branching process. We study the distribution and generation of random walk in the following 
theorems. 
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Theorem 3 Suppose {X n } is a random walk with stay and that q < p. Let T be its first passage 
time of position 1. Then 



1 — ru — y (1 — ru) 2 — 4pqu 2 

E{u T ) = — , \u\ < 1. 

Iqu 



Moreover if p = q = then 



lim y/nP(T > n = \ , 

n— >co V 7T \J 1 — r 



Theorem 4 Suppose that {X n ~} is a (2-1) random walk and that p — q\ — 2q<i > 0. Let h(u) be 
the probability generating function of the first passage time T. Then g(s) := sh(s) is the smallest 
real solution of equation 

92S~y + qi9 2 -g+ps = 0. (9) 

Remark 4 Results for random walk with stay look more satisfied. We give explicitly the prob- 
ability generating function of T, and calculate its tail probability. Indeed, in the proof of the 
theorem, we do give its exact distribution P(T = n). As far as (2-1) random walk is concerned, 
we could also solve equation (0|) to get the probability generating function h(s) ofT and expand 
h(s) to give its exact distribution. But since the root is complicated, we omit such calculation. 

We mention that for general (L-R) random walk, in a similar method one could use the 
branching structure to give the probability generating function of T. Of course, in this general 
case, the root for equation u = (j>(u) will be complicated. 

The remainder part of the paper is arranged as follows. Section [2] is a short introduction of the 
branching structure within random walk with stay and (2-1) random walk. Section 3 contains 
the proofs of the above theorems. 



2 Branching structures within random walks 

In this section, we introduce the branching structure within random walk with stay and (2-1) 
random walk. Firstly, consider random walk with stay. Recall that T = inf [n > : X n = 1] is 
the hitting time of position 1. Let 

(yP,ufA = (1, 0) and for % < 0, (10) 

and for i < define 

Up =#{0<n<T 1 :X n = i, X n+1 = i - 1}, 
U\ 2) = #{0 < n < Ti : X n = i, X n+1 = i} 

counting the number of steps by the walk from i to i— 1 and the steps from i to i itself respectively. 
Then it has been shown that is a 2-type branching process. We summarize 

the branching structure of random walk with stay {^ n } in the following theorem. For details of 
the proof, we refer the reader to Wang [9] and Zeitouni |10] , 
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Theorem A: Let {X n } be a random walk with stay. If q < p, then I ( Un \ Un^ ) \ defined 



n<l 



in t!0\) and ill]) forms a 2-type branching process. Its offspring distributions are 

P ((l/<»,E/f>) = M)| (Dffl,Dffl) = (1,0)) = ^AV, a,i> 0, 
p((£/W,E/f>)= (0,0)| (t/<J>,l/ffi) = (0,1)) =1. 
Moreover the hitting time T could be expressed by the branching process as 

T=1 + ^2U^ + UP. 

i<0 



Next, consider (2-1) random walk. Let T = inf[n > : X n = 1]. Define, for — oo < i < 0, 

£/f } = #{0 < k < T x : X fc _x > i, X k = %} 
UP = #{0<k<T 1 : X k ^ >i,X k = i- 1} 



(12) 



and set 

(^ ( Vi (2) )=(l,0). (13) 

Then we have the following theorem, whose proof could be find in Hong and Wang [3J. 
Theorem B: Let {X n } is a (2-1) random walk. Suppose that E(X\) = p — q\ — 2q2 > 0. Then 
l^i^j^i" 2 ^}. defined in [12]) and (T3\) forms a 2-type branching process with offspring 
distributions 



albl qiQ2P > 



p((ut\M-\) = (a,b)\(ul 1] 'M 2) ) = (1,0)) 
P ({ul%ufX) = (« + l,b)\(uPM 2) ) = (0, D) = ^rf<&> a,b > 

and that 

T = l + ^2[/f 1) +C/f ) . 



3 Proofs 

3.1 Proof of Theorem [j] 

We claim that for n > 0, G n +i(s) = s0(G„(s)) with Go(s) := s. Indeed, note that G± (s) = 
E(s Zo+Zl \Z = ei) = 8®E(s Zl \Z = ei) = sW^W(s). Then one follows that Gi(s) = s0(s). 
Suppose that G m +i(s) = s<£(G m (s)) for all m < n. Let /(v|u) = P{Z\ = v|Zo = u). Then 

G® + M = E(s z ° +z ^+- +z ^\Z = e*) 

= a C«) ^ s z i+"- +z " +z "+i/(z 1 |e i )---/(z„|z n _ 1 )/(z n+1 |z n ) 

Zl,...Z n + l 
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8 (i) s Zl +- +z "/(z 1 |e i )---/(z n |z n _ 1 ) ^s z "+ 1 /(z n+1 |z n ) 

s (i) £ ^ + - +z "/(zi|e l )---/(z n ,|z„_ 1 )(0(s)) z " 

Zl,...Z„ 

a (i) ^ s z 1 +-+ z «- 1 /(z 1 |e i )---/(z n |z„_ 1 )(G 1 (s)) z ". 



Zl,...Z„ 



Repeating the above procedure for n times, it follows that G^ +1 (s) = sM<^W(G n (s)). The claim 
is proved. 

For C s C 1, one easily sees that Gi(s) = s0(s) <C s = Go(s). Then one follows 
from induction that {G n (s)} is monotone decreasing in n. Consequently, the limit p(s) := 
lim n _ >00 G n (s) exists and p(s) satisfies equation 

p(s)= S 0(p(s)). (14) 

Next we show that for fixed C s C 1, equation ([3]) has only one solution. Suppose 7r is the 
smallest nonnegative root of equation 

u = 0(u). 

That is 7r is the extinction probability of the branching process. Then 7r <C 1 or = 1 ac- 
cording as a < 1 or > 1. From equation (|3|) we know that = s^cft^ (u^\ u^ 2 \ ti^) . 
Noting that, as a function of w 1 ', y (i^ 1 )) = s^4>^ {vP~,'uP'\ is strictly convex, thus 

u {l) = sW^i) (uW,^ 2 ',...,^) has at most two roots. Since < (0, u^ 2 \ 

and 7r^' > s^ 1 )^ 1 ) i/ 2 ), one concludes that for fixed u^ 2 \ ...,u^ there exists only 

one < < (j)^ 1 ' such that = s^(j)^ (u^\ vP\ u^ L n . On the other hand, since 
1 > sW^W (l,u^ 2 \...,u^) , ttW = sM(f>(V (uW,^ 2 ),...,^)) has no root in [ttW,1] Thus the 
solution of ([3]) is unique. 

Letting s = 1 in (114p one follows that p(l) = 7r. Then p(s) is an honest probability generating 
function if and only if a < 1. □ 



3.2 Proof of Theorem H 

As beginning, we prove the first part. From the offspring distributions and ((5]), one follows 
that 



a=0 6=0 



and that 
Therefore 



0(2)( s (l) )a (2)) = l. 



^ ^ ^ 1 — qsW — rs( 2 ) ' 

Next we form the probability generating function of the total progeny Y. We note that 
Condition [1] does not hold since the particles of the second type does not give offsprings. But 
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this causes no problem to use Theorem Q] since the conditions on the mean offspring matrix M 
are only used to ensure the extinction of the branching process. Indeed, one follows from Q 
that 

p(z& = «|z« = i) = p-Y-*U 
n+1 \p + qj p + q 

Thus, if q < p, tt = 1, that is, the branching process {Z n } is extinct and P(Y < oo) = 1. 

Let pW(s) = E(s Y \Z = ei), t = 1,2 and p(s) = (pW(s),p^(s)). Then One follows from 
Theorem [1] that p(s) solves the equation 

P = s0(p). 

Consequently, 

1 _ rs (2) -Jh- rS (2)) 2 - 4pgs« , , 
p(s) = (^)(s),p( 2 )(s)) = ( Vi_ ; M_ >JjW 

The first part of Theorem [2] follows. 

For the proof of the second part, letting p = q = in ([6]), one follows that if P(Zq = e\) 
1, the probability generation function of Y is 



1 - rs® - J(l-rsW) 2 -(l-r) 2 sW 
p W(s) = ; v > 

1 — r 

Let /3(u) := E(u^ Y ^) = E(u Yl u Y2 ), \u\ < 1 be the probability generating function of \Y\ 
Then one sees that 



p»=pW(u,u) 



_ 1 - ru - ru) 2 - (1 - r f 



1 — r 
Suppose that 

p» = A, + Piu + pV + .../3 n u n + ... 

and define for n > 0, 

#n = Ai+l + Ai+2 + •••• 

Then 8 n = P(\Y\ > n). Therefore, to prove ([7|), it is enough to show that 



1 4- r 

lim^ n = — ,/-^. (15) 

ra->oo ,/7r V 1 — 



For this purpose, define 

Q(u) = 6» + 0i« + 9 2 u 2 + ...6» n u n + \u\ < 1. 

One follows that 



»(«) = IfM = j^J 1 -^ - (16) 

1 — u 1 — r V 1 — it 1 — r 



In order to prove (|15p . we first prove the following lemma. 



S 



Lemma 1 For n > 0, let a n (x) = ^ 2 ^ n ^| !! x" and b n = ^^j" ; where \x\ < 1 and fc!! = for 
k < 0. TTten 

lim ^VflA^ = "^( 2 - Vl - x). 



fc=0 



Proof. Note that 
^ a-kK- 



k=0 



(2n-l)ll , (2n-3)!! (2n-5)ll x a 
(2n)!! " t " (2n-2)!! x (2n-4)!! 2 



+ 

[f]-l 

E 

fc=0 



(2n-7)!! 3!!x 3 , (2[§]-l)H (2[g] -3)HzW 

(2n-6)!! 6!! "•" — 



(2[f])!! (2[f])H 



(2n-2Jfe-3)!! (2fc - l)!!x 
(2n- 2fc)!! (2fc)!! 



|| r n— fe 



■ (Part I) 
•(Part II) 



Then using the fact 



< (2n- 1)!! /2 



vr V2n + 1 ~ (2n)!! 
we have that (Part I) of (|17|) is smaller than 

- 2 1 3!!x 2 



2 / 1 



+ 



1 x 



+ 



1 x l 



+ 



V2n - 2 2 ^2n - 4 4!! V2n - 6 6!! 
and (Part II) of (|17j) is smaller than 

■[f]-i 



vr V2n 



+ ... + 



1 (2[§-3])!!*[ 



E 



i 



(2fc- l)!!x n " fc 



vr ^ V (2n - 2k) 2n - 2ft - 1 (2ft)!! 
Denoting (fT8|) by f(n), we have that 

1 ^ (2n-3)!!x n 1 

n=0 

On the other hand, 



lim ^/W = ^V l T , =^(2-vT 
™^oo V M ; v 7 ^ _ (2n)!! \/vr 



lim \/n 



5-1 



7T 



1 



1 (2fc-l)!!x 



n—k 



n ^ V vr ^ ^(2™ - 2ft) 2n - 2k - 1 (2ft)!! 
Then (J7]), (JTSJ) and {2D]) imply that 

n 1 

lim a k b n ^ k < ~i={2 ~ 

n— >oo — * \/7r 
fc=0 

A similar argument yields that 



x). 



n i 
lim \/f!VaA_ t > -^=(2 - v/l - x). 

fc=0 v 



(17) 



(18) 



(19) 



(20) 
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The lemma is proved. □ 
Next we continue the proof of Theorem [2j Note that 



1 i A(2n-1) ! „ J r — i A 2n-3)!! 

, = 1 + > —, — 777— u n and V 1 - r 2 u = 1 - > ^ — --t— 
^l^H ^ 2n !! V ^ (2n )!! 

n=l n=l 



r 2n u n . 



Let cq = 1, <i = 1 and for n > 1, let c n = — w| !! r 2ra , d n = ^ 2 ," ^| !! . Then one has that 



(2n)!! ' > "n — (2n)! 
oo n 



1 - u 

n=0 fc=0 



Substituting to (|16fl . we have that #o = 1 and 

1 V- j 1 /(2n-l)!! A , 2 ,, 



k=0 v y fc=l 

1 /2(2n- 1)!! A , 2N , 



fc=0 

Using Lemma [H one follows that 



1 ll + r 

lim , 

n->oo 1 — r V \/7r V7T V / / a/7T V 1 — r 



which proves (fT5|) . 

The third part of Theorem [2] could be found in the proof of Theorem 2J □ 



3.3 Proof of Theorem [3] 

Let {^n} be a random walk with stay. Comparing the branching process {Z n } in Theorem [2] 
and{(^ 1} ,^ 2) )} n <\ in Theorem B (see Section [2]), if P(Z = ei) = 1 one follows that T has 
the same distribution with 

oo oo 

i + £ 2zw + z( 2 ) = 2^ 1} + 4 2) - 1 = 2yW + y( 2 ) - i. 

n=l n=0 

Letting 77(14) := £ , (ii T+1 ), then 



2 y(D y( 2) (1) 2 1 - ru - y/(l - ru) 2 - (1 - r) 2 u 2 

r)(u) = E(u u ) = p y '[u,u) = - . 

1 — r 

Define a n = P{T > n) and let a(u) = X^r^Lo a nU n . Similar as f)16|) we have that 



1 - n(u) 1 I - (2r - l)u r 

a(u) - 



1 — u 1 — r V 1 — it 1 — r 

Following the lines of the proof of the second part of Theorem [2j replacing r 2 by 2r — 1 , we could 
prove that 

1- 1/2 If , -\ \ [2 1 

lim ^a n = - ( 7= ( 2 - \A - (2r - 1) 



l-rV^/vr V V vr -y/1 - r 

□ 
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3.4 Proof of Theorem [4] 

We only give the idea of the proof since it is similar as that of Theorem [3l Let {-^n} be a (2-1) 
random walk. Suppose | \U^\ uj^j J is the process defined in Theorem B (see Section [5]). 

Let Z n = (Zn\ Zn^) = C/_2 + i) and Y = Yl^Lo^ri- Then one follows from Section [21 

Theorem B that 

T = 2Y (1) + y (2) - 1. 



It is easy to calculate that 

0(s) = (^ 1 )(s),^ 2 )(s)) 



p ps^ 1 ' 



1 - gisW - q 2 sW ' 1 - qxsW - q 2 s( 2 ) J ' 
Then one follows from Theorem [1] that p(u) = (p^\u) , p^ 2 \u)) is the smallest real solution of 

P = u0(p). 

That is, (pW(u),^ 2 )(u)) satisfies 

( (1) (2)) = ( Pu^ pvVpM \ 

{P ' P ' {l-q 1 pW- q2 p^ , l- qi pW-q 2 p( 2 ))- 

Therefore, p^ 1 ' (u) is the smallest real solution of 

q2 ^)( pil) ) 3 + qi (P (1) ) 2 -^ (1) +^ (1) = - 

Let 

'n(i) 



(2) 

pW(uW,n^):=F( q2 ^-, qi ,-l, P nW: 



be such a solution. 

Noting that sh(s) = E(s T+1 ) = E(s 2yW s y(2) ) = p( 1 )(s 2 ,s), one has that 

g(s) := sh(s) = F(q 2 s~ 1 ,q 1 , -l,ps), 

which is the smallest real solution of equation 

<?2S~ V + Qi9 2 ~ 9 + ps = 0. 
Theorem 0] is proved. □ 

Acknowledgements: The author wishes to thank Professor Wenming Hong, who advises 
him to consider this project. Thanks also extend to Miss Hongyan Sun for her discussion on the 
estimation of some specific series. 
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